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Abstract. Recently we have developed a new method in graph theory based on 
the Regularity Lemma. The method is applied to find certain spanning subgraphs 
in dense graphs. The other main general tool of the method, beside the Regularity 
Lemma, is the so-called Blow-up Lemma (^Jj). This lemma helps to find bounded 
degree spanning subgraphs in e-regular graphs. Our original proof of the lemma 
is not algorithmic, it applies probabilistic methods. In this paper we provide an 
algorithmic version of the Blow-up Lemma. The desired subgraph, for an n-vertex 
graph, can be found in time 0(nM(n)), where M(n) = 0(n 2 ' 376 ) is the time needed 
to multiply two n by n matrices with 0,1 entries over the integers. We show that 
the algorithm can be parallelized and implemented in NC 5 . 



1. Introduction 

1.1. Notations and definitions. All graphs are simple, that is, they have no loops 
or multiple edges. v(G) is the number of vertices in G (order), e(G) is the number 
of edges in G (size). deg(v) (or dega(v)) is the degree of vertex v (within the graph 
G), and deg(v,Y) (or dega(v, Y)) is the number of neighbours of v in Y. 5(G) and 
A(£r) are the minimum degree and the maximum degree of G. N(x) (or Na(x)) is 
the set of neighbours of the vertex x, and e(X, Y) is the number of edges between X 
and Y . A bipartite graph G with color-classes A and B and edges E will sometimes 
be written as G = (A, B, E). For disjoint X, Y, we define the density 

The density of a bipartite graph G = (A, B, E) is the number 

d{G) = d(A, B) 

For two disjoint subsets A,B of V(G), the bipartite graph with vertex set A U B 
which has all the edges of G with one endpoint in A and the other in B is called the 
pair (A, B). 

A pair (A, B) is e-regular if for every X d A and Y C B satisfying 

IX I > e\A\ and \Y\ > e\B\ 
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we have 

\d(X,Y)-d{A,B)\ < e. 
A pair (A, B) is (e, <5)-super-regular if it is e-regular and furthermore, 

deg(a) > 5\B\ for all a G A, 

and deg(b) > 5\A\ for all b G B. 

H is embeddable into G if G has a subgraph isomorphic to H, that is, if there 
is a one-to-one map (injection) ip : V(H) — > V(G) such that {x, y} G E(H) implies 
&(x),p(y)}eE(G). 

As the model of computation we choose the weakest possible version of a PRAM, 
in which concurrent reads or writes of the same location are not allowed (EREW, 



sec 



for a discussion of the various PRAM models.) When researchers investigate 
the parallel complexity of a problem, the main question is whether a polylogarithmic 
running time is achievable on a PRAM containing a polynomial number of processors. 
If the answer is positive then the problem and the corresponding algorithm are said 
to belong to class NC introduced in [|3^] (see also ||I0||,[38|). When the running time 
is 0((logn) 1 ), the algorithm is in NC\ 

1.2. An Algorithmic Version of the Blow-up Lemma. In recent years the in- 
teraction between combinatorics and the theory of algorithms is getting stronger and 
stronger. It is therefore not surprising that there has been a significant interest in 
converting existence proofs into efficient algorithms. Many examples of this type 
can be found in Jl|, [H[ . Some of these are general methods, so algorithmic versions 
of these methods immediately imply efficient algorithms for several problems. One 
example is the Lovasz Local Lemma whose algorithmic aspects have been studied 
recently in [Q, [/J. Another example is the Regularity Lemma |36 |. The basic content 



of this lemma could be described by saying that every graph can, in some sense, be 
well approximated by random graphs. Since random graphs of a given edge density 
are much easier to treat than all graphs of the same edge-density, the Regularity 
Lemma helps us to carry over results that are trivial for random graphs to the class 
of all graphs with a given number of edges. The lemma has numerous applications 
in various areas including combinatorial number theory |13|, [37]] , computational com- 



plexity @ and extremal graph theory 0g||,§§ [15], [HJ |33|, 0. Recently 
an AC^-algorithmic version was given in ||. 

During the past couple of years we have developed a new method in graph the- 
ory based on the Regularity Lemma. We usually apply this method to find certain 
spanning subgraphs in dense graphs. Typical examples are spanning trees (Bol- 
lobas-conjecture, see P3I), Hamiltonian cycles or powers of Hamiltonian cycles (Posa- 



Seymour conjecture, see |2H EH|) or if-factors for a fixed graph H (Alon-Yuster con- 



jecture, see p7| ). The other main general tool in the method, beside the Regularity 
Lemma, is the so-called Blow-up Lemma (||24||). This lemma helps to find bounded 
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degree spanning subgraphs in e-regular graphs. The rough idea of the original proof 
of this lemma was the following: we use a randomized greedy algorithm to embed 
most of the vertices of the bounded degree graph, and then finish the embedding 
by a Konig-Hall argument. Given the recent algorithmic version of the Regularity 
Lemma, the obvious question arises whether there is an algorithmic version also for 
the Blow-up Lemma. In this paper we give an affirmative answer to this question. 

Theorem 1. (An Algorithmic Version of the Blow-up Lemma) Given a graph 
R of order r and positive parameters 5, A, there exists an e > such that the following 
holds. Let N be an arbitrary positive integer, and let us replace the vertices of R with 
pairwise disjoint N-sets V\, V2, ■ ■ ■ ,V r (blowing up). We construct two graphs on the 
same vertex-set V = UVi. The graph R(N) is obtained by replacing all edges of R 
with copies of the complete bipartite graph K N>N , and a sparser graph G is constructed 
by replacing the edges of R with some (e, 5) -super-regular pairs. If a graph H with 
A(H) < A is embeddable into R{N) then it is already embeddable into G. We can 
construct a copy of H in G in 0(nM(n)) sequential time, where M(n) = 0(n 2 ) 
is the time needed to multiply two n by n matrices with 0,1 entries over the integers. 
Furthermore, the algorithm can be parallelized and implemented in NC 5 . 

Remark. For some very special cases of this theorem (e.g. a Hamiltonian path in 
a super-regular pair) NC algorithms can be found in f3~4| . 

When using the Blow-up Lemma, we typically also need the following strengthened 
version: Given c > 0, there are positive functions e = s(8, A, r, c) and a = a(8, A, r, c) 
such that the Blow-up Lemma remains true if for every i there are certain vertices x 
to be embedded into Vi whose images are a priori restricted to certain sets C x C Vi 
provided that 

(i) each C x within a Vi is of size at least c|Vj|, 

(ii) the number of such restrictions within a Vi is not more than a\Vi\. 

Our proof is going to be similar to our original probabilistic proof, but we have 
to replace the probabilistic arguments with deterministic ones. In Section 2 we give 
a deterministic sequential algorithm for the embedding problem without considering 
implementation and time complexity issues. In Section 3 we show that the algorithm 
is correct. Implementation is discussed in Section 4. Finally, Section 5 contains 
various algorithmic applications. 

2. The algorithm 

The main idea of the algorithm is the following. We embed the vertices of H one- 
by-one by following a greedy algorithm, which works smoothly until there is only a 
small proportion of H left, and then it may get stuck hopelessly. To avoid that, we 
will set aside a positive proportion of the vertices of H as buffer vertices. Most of 
these buffer vertices will be embedded only at the very end by using a Konig-Hall 
argument. 
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2.1. Preprocessing. We will assume that |V(i?)| = |V(G)| = |U;VJ| =n = rN. We 
can also assume, without restricting generality, that N > N (5, A,r), for Theorem 
|I] is trivial for small N since e-regularity with a small enough e implies G = R(N). 
Finally, we will assume for simplicity, that the density of every super-regular pair in 
G is exactly 5. This is not a significant restriction, otherwise we just have to put 
everywhere the actual density instead of S. 

We will use the following parameters: 

5"' < 5" < 5' < 5, 

where aCft means that a is small enough compared to b. 

For easier reading, we will mostly use the letter x for vertices of H, and the letter 
v for vertices of the host graph G. 

Given an embedding of H into R(N), it defines an assignment 

•*l>:V(H)^{V u V 2 ,...,V r }, 
and we want to find an embedding 

ip : V(H) — > V{G), f is one-to-one 

such that <f(x) 6 i/)(x) for all x G V(H). We will write Xj = ip^iVi) for i = 1,2, ... ,r. 

Before we start the algorithm, we order the vertices of H into a sequence S = 
(xi,X2, ■ ■ ■ , x n ) which is more or less, but not exactly, the order in which the vertices 
will be embedded. Let m = r \5'N~\ . For each i, choose a set of \S'N~\ vertices in 
Xi such that any two of these vertices are at a distance at least four in H. (This is 
possible, for if is a bounded degree graph.) These vertices b±, . . . , b m will be called 
the buffer vertices and they will be the last vertices in S. 

The order S starts with the neighbourhoods iV#(&i), Nnfo), ■ ■ ■ , iYff(& m ). The 

m 

length of this initial segment of S will be denoted by T . Thus T = 2J \Nn(bi)\ < 

i=i 

Am. 

The rest of S is an arbitrary ordering of the leftover vertices of H. 

(When certain images are a priori restricted, as in the remark after the theorem, 
we also list the restricted vertices at the beginning of S right after the neighbours of 
the buffer vertices.) 

2.2. Sketch of the algorithm. In Phase 1 of the algorithm we will embed the 
vertices in S one-by-one into G until all non-buffer vertices are embedded. For each 
Xj not embedded yet (including the buffer vertices) we keep track of an ever shrinking 
host set Hf jX that Xj is confined to at time t, and we only make a final choice for the 
location of Xj from H t)Xj at time j. At time 0, Hq x . is the cluster that Xj is assigned 
to. For technical reasons we will also maintain another similar set, C tiXj , where we 
will ignore the possibility that some vertices are occupied already. 

In Phase 2, we embed the leftover vertices by using a Konig-Hall type argument. 
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2.3. Embedding Algorithm. At time 0, set Cq, x = H 0tX = if)(x) for all x G V(H). 
Put Ti = [5"n\ . 

Phase 1 

For t > 1, repeat the following steps. 

Step 1 - Extending the embedding. We embed Xt- Consider the vertices in H t -i, Xt . 
We will pick one of these vertices as the image (p(xt) by using the Selection Algorithm 
(described below in Section |2.4p. 



Step 2 - Updating. For each unembedded vertex y (i.e. the set of vertices Xj,t < 
j <n), set 



and 



Ct,y 



H t,y 



C t - 


-1,2/ 


n N G (p{xt)) 


if {x t ,y}eE(H) 


C t - 


-1,2/ 




otherwise, 


H t . 


-1,2/ 


f]N G (if(x t )) 


if G E(H) 




-1,2/ 


\M*)> 


otherwise. 



Step 3 - Exceptional vertices in H. 

1. If Ti does not divide t, then go to Step 4. 

2. If Ti divides t, then we do the following. We find all exceptional unembedded 
vertices y G H such that \H ty \ < (5') 2 n. At this point we slightly change the order of 
the remaining unembedded vertices in S. We bring these exceptional vertices forward 
(even if they are buffer vertices), followed by the non-exceptional vertices in the same 
relative order as before. For simplicity we still use the notation (x 1 ,x 2 , ■ ■ ■ ,x n ) for 
the new order. 

Step 4 - Exceptional vertices in G. 

1. If t 7^ T , then go to Step 5. 

2. If t = T , then we do the following. We find the set (denoted by Ei) of those 
exceptional vertices v £ Vi, 1 < i < r for which v is not covered yet in the embedding 
and 

\{b:beB i ,veC t>b }\<5"\B i \. 

Once again we are going to change slightly the order of the remaining unembedded 
vertices in S. We choose a set E of vertices x G H of size J2i=i \Ei\ (more precisely 
l-Ejl vertices from for all 1 < i < r) with 

H t , x = Ho !X \ {<p(xj) : j <t} = ip(x) \ {<p(xj) : j < t}. 

Thus in particular, if x G A 7 ,, then Ei C H t , x . For example, we may choose the vertices 
in E as vertices in H that are at a distance at least four from each other and any of 
the vertices embedded so far. We are going to show later in the proof of correctness 
that this is possible since if is a bounded degree graph and Yh=i \Ei\ is very small. 
We bring the vertices in E forward, followed by the remaining unembedded vertices 
in the same relative order as before. Again, for simplicity we keep the notation 
(xi, x 2 , ■ ■ ■ , x n ) for the resulting order. After this we set t <— t + 1 and go back to 
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Step 1. However, when we perform Step 1 for a vertex x G E we pick (p(x) from the 
appropriate 

Step 5 - If there are no more unembedded non-buffer vertices left, then set T = t 
and go to Phase 2, otherwise set t <— t + 1 and go back to Step 1. 

Phase 2 

Find a system of distinct representatives of the sets H T y for all unembedded y (i.e. 
the set of vertices Xj, T < j < n). 

2.4. Selection Algorithm. We choose a vertex v G H t -i :Xt as the image ip(xt) for 
which the following hold for all unembedded y with {xt,y} G E(H) 

(5 -e)\H t _^ y \ < deg G (v,H t _ hy ) < (5 + £)\H t _ hy \, 
(6 - £)\C t -i,y\ < deg G (v,C t -i,y) < {5 + e)\C t -\, y \ 

and 

(5 - e)\C t - lt y n C t _iy| < deg G (v,C t - hy r\C t - 1:y/ ) < (5 + e)\C t - liy D C t _iy|, 
for at least (1 — e') proportion of the unembedded vertices y' with ^(y') — ^(v)- 

3. Proof of correctness 
The following claims state that our algorithm finds a good embedding of P into G. 

Claim 1. Phase 1 always succeeds. 

Claim 2. Phase 2 always succeeds. 

If at time t, S is a set of unembedded vertices x <E H with VK 2 -) = ^ then we define 
the bipartite graph U t as follows. One color class is S, the other is V*, and we have 
an edge between a rr G 5 and a v G whenever t> G Ct )X . 

In the proofs of the above claims the following lemma will play a major role. 

Lemma 2. We are given integers 1 < i < r, 1 < t < T and a set S C Xi of 
unembedded vertices at time t with \S\ > (5"') 2 \Xi\ = (5"') 2 N. Then apart from an 
exceptional set F of size at most e"N , for every vertex v G V* we have the following 

deg Ut (v) = \{x : x G S,v G C t , x }\ > (1 - e")d{U t )\S\ ^> 5 -^\S^j . 

Proof. In the proof of this lemma we will use the "defect form" of the Cauchy- 
Schwarz inequality (just as in the original proof of the Regularity Lemma): if 

J2X k = -J2X k + A (m<n) 

k=l n k=l 
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fc =i n vs / m ( n - m ) 

Assume indirectly that the statement in Lemma |2] is not true, that is, \F\ > e"N. 
Let us write u(t, x) for the number of neighbors (in H) of x embedded by time t. 
Then in Ut we have the following. 

e(U t ) = d(U t )\S\\Vi\ = £ deg Ut (v) = ^deg Ut (x) = ]T \C tjX \ > ^(6 - e)"^N. 

v&Vi x&S xdS x€S (1) 

We also have 

J2 E \N Ut (xi) n N Ut ( X2 )\ < £ Y,( s + £ ) u(t ' xl)+u{t ' X2)N + ^' N \ s \ 2 - 

x!€Sx 2 gs x 1 eSx 2 es (2) 

On the other hand using (|l|) and the Cauchy-Schwarz inequality with m = \e"N] , 
we get 

£ £ \N Ut (x 1 )nN Ut {x 2 )\ = y £{deg Ut (v)) 2 > 
>^(e^(^)) + (e") 3 d(U t ) 2 N\S\ 2 > 



>^(j2( S ~ zY (t ' x) N) + (e") 3 S 2A N\S\ 2 > 
> E E ( 5 - eY^+^'^N + (e") 3 6 2A N\S\ 2 , 

XI&S X2&S 

which is a contradiction with (fj), if e" is sufficiently large compared to e' and e. 
An easy consequence of Lemma ^ is the following lemma. 

Lemma 3. We are given integers l<i<r,l<t<T,a set S C of unembedded 
vertices at timet with \S\ > 8"'\Xi\ = 5"'N and a set A C V* with \A\ > S"'\Vi\ = 5"'N. 
Then apart from an exceptional set F of size at most (8"') 2 N, for every vertex x E S 
we have the following 

\AnC t , x \>^\C t , x \. (3) 

Proof. Assume indirectly that the statement is not true, i.e. there exists a set 
S' C S with \S'\ > (5"') 2 N such that for every x e S' @ does not hold. Once again 
we consider the bipartite graph U t = U t (S', Vi). We have 

= £ \Anc tjX \ <^E \ c t,*\ = ^1 d(u t )\s'\N. 

veA xes' ZiV xes' ZiV 
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On the other hand, applying Lemma |2| for S' we get 

£ deg Ut (v) > (1 - e")d(U t )\S'\(\A\ - e"N) 

contradicting the previous inequality. 
Finally we have 

Lemma 4. For every 1 < t < T and for every vertex y that is unembedded at time 
t, we have 

\H t J > 8"N. 

Proof. Indeed, Lemma fj implies that every time option 2 is executed in Step 3 
(i.e. Ti\t), we find at most (5"') 2 N (^C 8"N) exceptional vertices. This fact clearly 
implies Lemma |j. 

Lemma |2| implies that for Ei in Step 3 of Phase 1 of the Embedding Algorithm we 
have \Ei\< e"N, thus 

r 

^2\Ei\< re"N. 
i=i 

Lemma |] implies that the Selection Algorithm always selects from a set of size at 
least S"N. Furthermore, since \H ty \ > eN for every 1 < t < T and for every vertex 
y unembedded at time t, the £-regularity and some simple computation imply that 
at most e'N (^C 5"N if e' is small enough) vertices violate the degree requirements 
in the Selection Algorithm. Therefore the Selection Algorithm always succeeds in 
selecting an image (p(xt), proving Claim 1. 

Proof of Claim 2. We want to show that we can find a system of distinct repre- 
sentatives of the sets Ht x ,T < j < n, where the Ht x -s belong to a given cluster 
Vi- 

To simplify notation, let us denote by Y the set of remaining vertices in Vi, and by 
X the set of remaining unembedded (buffer) vertices assigned to V{. If x = Xj G X 
then write H x for its possible location HT )Xj at time T. Also write M = \X\ = \Y\. 

The Konig-Hall condition for the existence of a system of distinct representatives 
obviously follows from the following three conditions: 

\H X \> 5"'M for all x G X, (4) 
I U H x \ > (1 - 5"')M for all subsets S C X, \S\ > 5"'M } (5) 

| U H x \ = M for all subsets S C A, \S\ > (1 - 8"')M. (6) 

(^) is an immediate consequence of Lemma ^, (^) is a consequence of Lemma fj. 

Finally to prove @, we have to show that every vertex in Y C Vi belongs to 
at least 5'"|A| sets H x . But this is trivial from the construction of the embedding 
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algorithm, in Step 3 of Phase 1 we took care of the small number of exceptional 
vertices for which this is not true. This finishes the proof of Claim 2 and the proof 
of correctness. 

4. Implementation 

The sequential implementation is immediate. In Phase 1 we have < n iterations, 
and it is not hard to see that one iteration can be implemented in 0(M(n)) time. 
Phase 2 can be implemented in 0(riV 5 / 2 ) = 0(M(n)) time by applying an algorithm 



for finding a maximum matching in a bipartite graph (see e.g. |2y, |29fl). 

For the parallel implementation, our main tool is the NC 4 algorithm for the maxi- 
mal independent set problem. A subset / of the vertices of a graph G is independent 
if there are no edges between any two vertices in /. An independent set I is maximal 
if it is not a proper subset of any other independent set. Karp and Wigderson ([[22]j) 
were the first to give an iVC 4 -algorithm for this problem. Better algorithms were 
later described in (§ |T7|, 0, |31J . We call this the MIS algorithm. 

For the parallelization of the embedding algorithm, we show that if a is a small 
enough constant and n! is the number of remaining unembedded vertices, then we 
can embed \_an'\ vertices in parallel. First we pick these vertices by running the MIS 
algorithm on the following auxiliary graph. The vertices are the vertices of H, and 
we put an edge between two vertices, if either they are at a distance less than 4, or 
both vertices are embedded already. If in the maximal independent set that we find, 
we have a vertex that is embedded already (we can have only one such vertex), then 
we remove this vertex from the independent set. We keep \_an'\ vertices from the 
remaining vertices. These vertices are brought forward in the order in the embedding 
algorithm and we embed these vertices in parallel. For each such vertex we determine 
the set of vertices where it could be embedded by the embedding algorithm. Once 
again running the MIS algorithm on the appropriately defined auxiliary graph, we can 
choose a distinct representative from these sets. Finally we embed each vertex to its 
representative. We iterate this procedure until the number of remaining unembedded 
vertices is < (logn) 5 , and then we embed these vertices sequentially. Thus Phase 1 
can be implemented in 0(logn(logn) 4 ) = 0((logn) 5 ) parallel time. 

For Phase 2 it remains to show, that if the bipartite graph U t is defined as above 
between X and Y (i.e. there is an edge between x G X and v G Y if and only if 
v G H x ), then we can construct a perfect matching in Ut in NC 4 . For this purpose we 
obtain a maximal matching by running MIS on the linegraph of Uf. Then obviously 
for the remaining unmatched vertices, say Z(X) and Z(Y), \Z(X)\ = \Z(Y)\, and 
Z(X) U Z(Y) is an independent set. From (|5|) |Z(X)| < 5"'N follows. Furthermore, 
Lemma |3] and Lemma |3] imply that, if we take x G Z(X),v G Z(Y), then there 
are many (^> 5"'N) (internally) vertex-disjoint alternating paths of length 5 between 
x and v . Running again MIS on an appropriately defined auxiliary graph, we can 
find vertex-disjoint alternating paths of length 5 between the pairs in Z(X) U Z(Y). 
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Changing the matching edges to non-matching edges on these paths we get a perfect 
matching. 



5. Applications 

In most applications of our method, the only non-constructive parts are the Reg- 
ularity Lemma and the Blow-up Lemma. Therefore, the existence proofs together 
with the NC 1 version of the Regularity Lemma and Theorem [I], provide several im- 
mediate algorithmic applications. Let us mention here three applications. Additional 
applications and the details of the proofs will appear in the full version of the paper. 



Theorem 5. (Existential version in |23|| ; NC-version in [S^Jj Let A and < 5 < 1/2 
be given. Then there exists an no with the following properties. If n> no, T is a tree 
of order n and maximum degree A, and G is a graph of order n and minimum degree 
at least ((1/2) + 5)n, then T is a subgraph of G. Furthermore, a copy ofT in G can 
be found in 0(nM(n)) sequential time as well as in NC 5 . 



Theorem 6. (Existential version in §2(^) There exists an no such that if G has order 
n with n > n and 5(G) > 2n/3, then G contains the square of a Hamiltonian cycle. 
Furthermore, a copy of a square of a Hamiltonian cycle can be found in 0{nM{n)) 
sequential time as well as in NC 5 . 



Theorem 7. (Existential version in [p5[] J For any p > and positive integer k there 
exists an n = n (p, k) such that if G has order n > n and minimal degree 

then G contains the k th power of a Hamiltonian cycle. Furthermore, a copy of the 
k th power of a Hamiltonian cycle can be found in 0{nM(n)) sequential time as well 
as in NC 5 . 
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